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Abstract 

Applying the well-known Feynman-Kac formula of inhomogeneous case, an inter- 
esting and rigorous mathematical proof of generalized Jarzynski's equality of inhomo- 
geneous multidimensional diffusion processes is presented, followed by an extension of 
the second law of thermodynamics. Then, we explain its physical meaning and appli- 
cations, extending Hummer and Szabo's work (Proc. Natl. Acad. Sci. USA 98(7), 
3658-3661 (2001)) and Hatano-Sasa equality of steady state thermodynamics (Phys. 
Rev. Lett. 86, 3463-3466 (2001)) to the general multidimensional case. 
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1 Introduction 

Thermodynamics of irreversible systems far from equilibrium has been developed for more 
than thirty years since the original works by Haken |X3|, [___] about laser and Prigogine, 
et al. \\.'2\ [HTj about oscillations of chemical reactions. A nonequilibrium system can be 
regarded as an open system with positive entropy production, which means exchange of 
substances and energy with its environment. 

At almost the same time, T.L. Hill, etc. |17l [181 f!9l 120] constructed a general meso- 
scopic model for the combination and transformation of biochemical polymers in vivid 
metabolic systems since 1966, which can be applied to explain the mechanism of muscle 
contraction and active transports, such as the Na and K ions actively transferring and 
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penetrating through organic membranes in the Hodgekin-Huxley model. These contribu- 
tions have been developed and summarized in |27j . 

One can use stationary homogeneous Markov chains and diffusion processes as math- 
ematical tools to model nonequilibrium steady states and cycle fluxes. Mathematical 
theory of nonequilibrium steady states has been developed for more than three decades 
since Qians' original works |35t [36l \3T\ 138] . They derived the formulae for entropy pro- 
duction rate and circulation distribution of homogeneous Markov chains, Q-processes and 
diffusions. They concluded that the chain or process is reversible if and only if its entropy 
production rate vanishes, or iff there is no net cycle fluxes. Here, we recommend a recent 
book [26] for the systematic presentation of this theory. 

In the past decade, a few relations that describe the statistical dynamics of driven sys- 
tems have been discovered, which are valid even if the system is driven far from equilibrium. 
These include Jarzynski's exciting nonequilibrium work relation [22J E31 E31 El El H] > which 
gives equilibrium Helmholtz free energy differences in terms of nonequilibrium measure- 
ments of the work required to switch from one ensemble to another. This result has been 
applied to the mechanical extension of single RNA molecules in the laboratory [30J. Al- 
though the concept of Helmholtz free energy fails in nonequilibrium steady states (NESS), 
Hatano and Sasa [16] have generalized Jarzynski's work to the NESS described by a simple 
one-dimensional Langevin system, which is more relevant to motor proteins. 

However, few rigorous mathematical results are derived since the emergence of Jarzyn- 
ski's equality. Applying the Feynman-Kac formula, G. Hummer and A. Szabo gave a quite 
brief proof of Jarzynski's equality for inhomogeneous diffusive dynamics on a potential 
[21j . and after that, Hong Qian investigated a simple two-state example of inhomogeneous 
Markov chains [33] • But in fact, their proofs are not mathematically rigorous, and they all 
misused the Feynman-Kac formula of the inhomogeneous case |28t Theorem 5.7.6], since 
it is quite different from the Feynman-Kac formula of the homogeneous case [28} Theo- 
rem 4.4.2] and the former is actually more difficult to apply than the latter one. Further 
explanation is included in Subsection 3.1. On the other hand, the Jarzynski's equality 
is trivial in the homogeneous case (see Remark 12.101 below) , which actually implies that 
inhomogeneity is a necessity for Jarzynski's equality to make sense. 

Recently enlightened by the work of Crooks [4], we gave a completely different and 
interesting rigorous derivation of the Jarzynski's equality in inhomogeneous Markov chains 
|10j . without applying the Feynman-Kac formula. Moreover, we investigated the relation- 
ship between Jarzynski's equality and the statistical physical property in the model of 
inhomogeneous Markov chains, including reversibility and entropy production [3(9]. 

Nevertheless, it is not easy to extend the main idea of proof in [lUj to the case of inho- 
mogeneous diffusion processes, because by this way, one needs a very general version of the 
Cameron-Martin-Girsanov formula similar to |401 Thm. 6.4.2], which is difficult to derive. 
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be regarded as the limit of inhomogeneous Markov chains, and in most of their works, 
they actually only proved the corresponding results in the case of inhomogeneous Markov 
chains rather than diffusion processes. However, from the mathematical point of view, 
inhomogeneous diffusion processes can only be regarded as the limit of inhomogeneous 
Markov chains in distribution rather than in trajectories. Hence, the Jarzynski's equal- 
ity in inhomogeneous diffusion processes can not be directly derived as the limit in some 
sense of that in inhomogeneous Markov chains, and we have to appeal to the Feynman-Kac 
formula of inhomogeneous case. 

In this paper, applying the well-known Feynman-Kac formula of inhomogeneous case, 
an interesting and rigorous mathematical proof of generalized Jarzynski's equality in inho- 
mogeneous multidimensional diffusion processes is presented in Section 2, followed by an 
extension of the second law of thermodynamics. It should be mentioned that the method 
of proof in the present paper can also be applied to derive the same Jarzynski's equality in 
inhomogeneous Markov chains as [10], or even possibly to extend to general Markov pro- 
cesses. In Section 3, we explain its physical meaning and applications, extending Hummer 
and Szabo's work [2T] and Hatano-Sasa equality of steady state thermodynamics PH)] to 
the general multidimensional case. 

In order to make the present paper accessible to a somewhat wider audience, some rea- 
sonable sufficient conditions for Jarzynski's equality of inhomogeneous diffusion processes 
are provided in Remark 2.7 below. 

2 Mathematical theory of generalized Jarzynski's equality 

2.1 Basic property of inhomogeneous diffusion processes 

This subsection is about the construction of inhomogeneous diffusion processes applying 
the fundamental solutions of partial differential equations. The conditions given here are 
somewhat optimal, and the readers who are not interested in technical details can directly 
skip to the next subsection for the proof of generalized Jarzynski's equality. We note here 
that most of these conditions including (Al), (A2) and (A4) are satisfied when all the 
coefficients belong to the smooth function set C°° and all the derivatives are uniformly 
bounded. 

Denote A t (x) = (ciij(t,x))dxd and bt{x) = (bi(t, x))dxi, where aij(t,x) and bi(t,x) are 
functions defined on [0, +oo) x M. d . Suppose that 

(Al) aij(t,x),t>i(t,x) are uniformly bounded and uniformly continuous with respect to 
both x and i, and also satisfy a Holder condition with respect to x; 
(A2) aij(t,x) satisfy a Holder condition with respect to t; 

(A3) dij(t,x) satisfy the uniform ellipticity condition, i.e. there exists 7 > 0, such that for 
any d-dimensional real vector A = (Ai, A2, • • • , A^), 



d d 

a ij (t,x)X i X j > A, 2 ; 

i,j=l i=l 

(A4) The derivatives ^f, g x °q x , ^ exist, uniformly bounded and satisfy a Holder con- 
dition with respect to x. 

For simplicity, let b t = (bi(t,x)) dxl and bi(t,x) = bi(t,x) - \ Yfj=i ^ix-^ ■ 
Theorem 1 2 . 1 1 b elow is rewritten from [51 Vol II, Theorem 0.4, pp. 227] and [7, Chap. 1, 
Sec. 6, Theorem 11, pp. 24; Chap. 1, Sec. 8, Theorem 15], and Theorem 12.31 is rewritten 
from [5j Vol I, remark of Theorem 5.11, pp. 167] and [H Chap. 4]. One can also find the 
same results in [281 PP- 368-369] and [3Ql Chapter 3]. 

Theorem 2.1 // the coefficients satisfy conditions (Al), (A2), (A3), then the equation 

P s +D s u = 0, (1) 

where D s u(s, x) = \ £f J=1 ^(s, + £? = i ^ x )mi = (l V " A & z)V + b(s, x) ■ 

V)u, has a unique fundamental solution p(s,t;x,y), satisfying: 
(Bl): p(s,t;x,y) > for each s, t and x, y; 

(B2): In addition, if coefficients a>ij(t, x),bi(t, x) satisfy (A4), then p(s , t; x , y) satisfies the 
conjugate equation: 

where D* t u{t, y) = £ f =1 ^ [± £^ =1 «u (*, 2/)^ " l/M*, v)\ = V • [| A(t, y)V«(t, y) - 
b{t,y)u(t,y)]; 

(B3): For any bounded continuous function f(x), u(s,t,x) = f p(s,t;x,y)f(y)dy satisfies 
(Jl) and linvff u(s, t, x) = f(x), which is uniformly convergent in any bounded domain of 
M d ; v(s,t,y) = J p(s,t;x,y)f(x)dx satisfies and hm^ s v(s, t, y) = f(y), which is also 
uniformly convergent in any bounded domain o/R d ; 
(-B4) : The following inequalities are satisfied: 



p(s,t;x 
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dp(s, t; x, 
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dxi 
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,y) 


dxidxj 




dp(s, t; x, 


y) 


dt 



< M(t - s) ~e~ 



<M(t-s)~i~ l e *- 
< M(t - s)~^~V 



p(s,t;x,y) > Mi(t- s)~fe ^ - M 2 (t - s)~f +A e 



where M, Mi, M2 and a, cti, ai are all positive constants. 

(B5): If f(x) is a bounded function with second-order continuous derivatives, which satisfy 
a Holder condition, then u(s,t,x) = f p(s,t;x,y)f(y)dy satisfies 

du df d 2 u d 2 f 

hm — — = — — , 11m ■ 



s]t dxi dxi ' s]t dxidxj dxidxj ' 

while v(s,t,y) = f p(s,t;x,y)f(x)dx satisfies 

dv df .. d 2 v d 2 f 
hm — — = — — , hm ■ 



t[s dyi dyi Us dyidyj dyidyj 

Remark 2.2 Most of the following definitions of physical quantities make sense due to 
the basic inequalities in (-B4) together with (-B3) and (.65). 

Theorem 2.3 There exists a unique inhomogeneous diffusion process X = {Xt : t > 0} 
on M. d , whose transition probability density is {p(s,t;x,y)}. Moreover, X is a strong 
Markov process. We call X the diffusion process with infinitesimal generator D . 

Equation (TT]) is called the backward Kolmogorov equation of X, while equation ([2]) is 
called the forward Kolmogorov equation of X. 

Denote the initial distribution density of X as {po(x) > : x G M. d }, which is at 
least twice differentiable, then pt(x) = J Po(y)p(0, t; y, x)dy is the density function of X t , 
simply denoted as pt- Thus from (B3), pt{x) satisfies ([2]), which is called the Fokker-Planck 
equation. 

Indeed, due to the condition (^43), there exists a nonsingular d x d matrix = 
(Tij(t, x))dxd such that A t (x) = T t (x)Tf(x), where Tf(x) is the transpose matrix of T t (x). 
The inhomogeneous multidimensional diffusion process {Xt : t > 0} can be considered as 
the unique solution of the stochastic differential equation 

dX t = b t (Xt)dt + T t (X t )dW t , 

where {Wj}t>o is a <i-dimensional Wiener process. 

2.2 Rigorous proof of generalized Jarzynski's equality 

Fix the time interval as [0, T], In order to make the quantities in Jarzynski's equality 
below mathematically well-defined, we have to make another basic assumption: 

(A5) The elliptic equation Dtf(x) = has a unique strong L 1 solution it t = {^t(x) ■ 
x £ R d } such that f Rd 7r t (x)dx = 1, recalling D*7r t (x) = ^ti E?=i ^j{t,x)^^ - 
bi(t, x)TTt(x)] = V • x)Vir t (x) — b(t, x)irt(x)]. Moreover, TVt{x) is continuously differ- 

entiable and uniformly bounded with respect to parameter t S [0,T]; ^i&U j s uniformly 
bounded too for t E [0,T]. In addition, suppose nt (x) > 0, Vx e R d , t > 0. 



Remark 2.4 Consider a homogenous diffusion process with infinitesimal generator D = 
• A(x)V + b(x) ■ V. In the uniformly elliptic case, if D*ir(x) = has a positive strong 
L 1 solution such that J Rd ir{x)dx = 1, it is unique. To have a solution one has to impose a 
sufficiently strong inward drift at infinity, or equivalently suppose that the homogeneous 
diffusion process is positive recurrent [151 Chap IV]. 

Physicists are interested in some reasonable sufficient conditions. A particular example 
is the equilibrium case discussed in the next section. More generally, it is sufficient to sup- 
pose that the diffusion coefficient A(x) is bounded and uniformly elliptic, b(x) is bounded 
smooth, and for large x, it is the minus gradient of a confining potential U(x), which is 
satisfied for many physical problems. The proof can be based on the Lyapunov function 
criteria for asymptotic stability of stochastic dynamic systems ( \29\ Theorem 11.9.1] and 
[151 Theorem III.5.1]): 

If there exists a smooth function V(x) with the properties 

V(x) > 

and 

lim sup DV(x) = — oo, 
R ^°° \x\>R 

then there exists a stationary distribution for the diffusion process. 
Therefore, if the potential U(x) satisfies that 



sup 

\x\>R 



• A(x)VU(x) + b(x) ■ W(x) 



- V • A(x)VU{x)- || VU(x) ||1 



sup 

|x|>_R 

> — oo as R — ► oo, (3) 



where || v [||= Yli=i v 1 j then D*tt{x) = has a unique positive strong L 1 solution such that 
J R d Tv(x)dx = 1. For example, the sufficient condition ([3|) is satisfied when the potential 
U (x) is a polynomial with even highest order. 

Another nontrivial example is the multidimensional Ornstein-Ulenbeck process with 
drift coefficients Bx = (bij),ixd' x and diffusion coefficients a = {(Tij}dxr- Its corresponding 
Fokker-Planck equation is 

Tt = 2^ a ^dx-dx- 3 -^^ l{X)Ul 

i,j = l i=l 

where bi(x) = Ylj=i bijXj and a%j = Ylk=l a ik°'jk- It is well known that its unique station- 
ary distribution is a multidimensional normal distribution with mean zero and variance 
S = Jq + °° e Bs 'Ae Bl s ds, provided that the matrix A = (a^) is nonsingular and the real 
parts of all eigenvalues of B = (bij)dxd are negative. 



According to [29 s Example 11.9.2], the Ornstein-Ulenbeck semigroup determined by the 
above Fokker-Planck equation is asymptotically stable with limiting density of N(0, £). 
Moreover, according to [26, Theorem 3.3.7], the stationary multidimensional Ornstein- 
Ulenbeck process is reversible (or say, in equilibrium state) if and only if the force F = 
2A~ 1 Bx is the gradient of a potential U(x) satisfying J e u ^dx = 1, of iff the coefficient A 
and B satisfy the symmetry condition A~ l B = (A~ 1 B) T [33]. Therefore, nonequilibrium 
Ornstein-Ulenbeck processes can only exist in the multidimensional (d > 2) case. 

One could also require that the diffusion process is confined to some compact set or 
manifold (e.g. torus), and the same arguments below can also be applied to prove the 
Jarzynski equality in those cases without any difficulties. 

n t can be called the quasi-invariant distribution^ at time t. 

Fix the initial distribution density p$ = ttq, which is one of the key points in Jarzynski's 
equality. Given an arbitrary absolutely continuous function F(t), denote 

H(t,x) =F(t) -/T^og^x), VxeM d . (4) 

Then 

p -/3H(t,x) 



and 

F{t) = -p-Hn [ e- pH{t > x) dx, 
where (3 > is a constant. Let 



W(u>) 



T d[F(s) - ilogvr s (X s )] 



o 







ds 

ds 



ds 



^-^iW',, (5) 



where AF = F{T) - F(0). Write 

A5(w) = H(T,X T )-H(0,X ), (6) 

and 

Q(u) = AH(u)-W(u). (7) 

The following theorem is the basis of our proof, which is an application of the famous 
Feynman-Kac formula in inhomogeneous case \28\ Theorem 5.7.6]. 



1 The notion "quasi-invariant distribution" means that if one takes A(t,x) and b(t,x) as the diffusion 
coefficient and drift coefficient of a homogeneous diffusion process respectively, mix) is just its invariant 



Theorem 2.5 Under the preceding assumptions, let Wd = W—AF = — ~^~gg" ^ (X s )ds, 
and denote 

v(t,x) = -E^exp 



{X s )ds 



., (8) 

or 

where Et. x means the expectation is taken conditioned on the event {Xt = x}, then v(t,x) 
satisfies the Cauchy problem 

f ^(t,x) = - d -^^v(t,x)-D t v(t,x), 
\v(T,x) = l, 

recalling that Dfv(t,x) = (^V • A(t,x)X7 + b(t,x) ■ X7)v(t,x). Moreover, such a solution is 
unique. 



Proof: We only need to check the condition of Theorem 5.7.6 in 

First, according to Vol II, Theorem 0.4, pp. 227], the Cauchy problem ([9]) has a 
solution v(t, x) which is continuous and satisfies the exponential growth condition 

max \v(t, x)\ < Me' 1 " 1 " 2 , x G R , 

0<t<T 

for some constants M > and [i > 0. 

Moreover, due to the condition (Al), the coefficients a,ij(t, x) and bi(t, x) are uniformly 
bounded with respect to t and x. 

Finally, applying [281 Theorem 5.7.6 and Problem 5.7.7], together with Theorem 12.11 
and Theorem 12.31 we get the desired result. | 

Now, it is time to derive the generalized Jarzynski's equality of multidimensional dif- 
fusion processes. 

Theorem 2.6 Under the preceding assumptions, suppose that 

(i) J Wt(x)v(t, x)dx < +oo for t G [0, T], and j *g*(j^MM0] ^ x are uniformly convergent 
for t G [0, T]; and 

(ii) for each i and j, 

lim TT t (x)bi(t, x)v(t, x) =0, 

x— >oo 

dv(t,x) 

hm 7r t {x)aij{t,x) — = 0, 



dx 



j 



dirt(x) 

hm — aijlt,x)v(t,x) = 0; 

" OXi 



then we have 

E p ^n [e- pw *\ = 1, (10) 

i.e. 

3AF 



E P l0 , T] [e -m ] = e -pi 



Proof: Let g(t) = J ir t (x)v(t, x)dx, our aim is to show that g(t) = 1, Vi G [0, T]. 
Firstly, due to the assumption (i), it holds that 



_ f d[TTt{x)v(t,x)] dx 



dt / dt 



—^± v (t,x)+ir t (x) — (t,x) 



dx, 



according to |44| Vol. Ill, Section 21.3, Theorem 4, pp.395]. And from Theorem 12.51 
follows that 

8-kAx) dv 

-v(t,x) + Tr t {x) — (t,x)dx 



dt v ' y ' tw dt 

8-kAx) , . . . 
—^(t^+vr^x) 

-ir t (x)D t v(t,x). 



^^v(t,x)-D t v(t, X ) 



Then, with the assumption (ii), integrating by parts, one has 
dg{t) 



dt 



ir t (x)D t v(t,x)]dx = / [-v(t,x)DtTr t (x)]dx = 0, Vt > 0, 



which together with the fact that g(T) = 1 implies g(t) = 1. Therefore, g(0) = E p ^ \e~^ Wd \ 
L ■ 
Remark 2.7 Reasonable sufficient conditions 

Some physicists may think that the conditions given in this paper are more general than 
ever needed, and they would be satisfied with reasonable sufficient conditions for the va- 
lidity of the Jarzynski equality. As we have mentioned at the beginning of this section, 
it is sufficient to assume (a) all the coefficients are bounded, at least twice continuously 
differentiable and all the derivatives are uniformly bounded too; (b) the diffusion coef- 
ficients At(x) are uniformly elliptic (see (A3)); and (c) the existence of quasi-invariant 
distributions (see (A5) and Remark 12. 4p . However, the technical requirements (i) and (ii) 
in Theorem 12.61 are still not easy to be verified, because we do not have exact estimation on 
the quantity v(t,x). But we believe that the conditions (a), (b) and (c) should be able to 
guarantee the technical requirements (i) and (ii). Especially, in the equilibrium case (see 
Subsection 3.1), it would be sufficient to suppose that H(t, x) > oo and. | — — -| — > oo els 
x —> oo. and X{ • — q x ' - > for all i and sufficiently large x. 

In addition, one can explicitly calculate the quantity v(t,x) in some very special case. 
For example, consider the one-dimensional diffusion dynamics 

dX t = -{X t - t)dt + adW t 

on a moving potential U(t,x) = \{x — t) 2 , which is investigated by van Zon and Cohen 
|4 H 1421 and mentioned in [1]. Its quasi-invariant distribution vrj(x) = -^^e ^ . 
Consequently, H(t,x) = ^ J) , the Helmholtz free energy F(t) = — logy/ira, and 

<- T dH. 



w d 



W = I 97 (S ' Xs)dS 

2 l' T 
= / (X, - s)ds. 



The unique solution of this stochastic differential equation can be expressed as 
X s = e l - s X t +{s + e 1 ' 8 - te 1 ' 8 - l) + ae~ s e u dW u , V s > t > 0. 

Let 



2 f T 

= k / (X a - s)ds 

= -^2 J {e l - s X t + e l - s -te l - s -l + <ye- s J\ u dW^jds. 

Because the process {Xt : t > 0} is Gaussian, one only needs to calculate the expectation 
and variance of the quantity Y^: 



Et,xY/ 



(e*~ s x + e 1 - 8 - te*" 8 - l) ds 



— [{x + 1 - t) (1 - e l - T ) - T + t], 



and 



Var t)X Yi = Var tiX 



- I e 

a 



e u dW u ds 



Van.* 



T 



a* 



a 

T / r-T 



e u dW u / e~ s ds 



t \J u 



e u ~ 8 ds du 



T-t -2(1- e*- T ) + - (1 - ( 



2t-2T\ 



Therefore, 



v(t,x) = E tiX e y ' T = exp 



cxp 



-Et, x Y/ + 



1 



Var t<x Y t T 



1 



x (1 _ e *-T) _ ± _ t + ( t + 1)e t-T _ ^2t-2T 



Finally, it is easy to check that the process {Xt : t > 0} satisfies the requirements (i) and 
(ii) in Theorem 12,61 and the quantity 



g(t) = I 7r t (x)v(t,x)dx 



exp 



(x-t-l + e^f 



(7- 



dx = 1. 



Definition 2.8 We call the inhomogeneous multidimensional diffusion process X = {X(t)} 
is unperturbed, if lit, < t < T , are all the same. 



The following is an extension of the second law of thermodynamics. 



Theorem 2.9 E p l°^W d > 0, i.e. 

E p i°' T W>AF. (11) 
Moreover, E Pl -°' T ^W = AF if and only if 

J ~^~ 1 ( X ^ UJ )) ds = °> P [o,T] ~ as. 

If the inhomogeneous multidimensional diffusion process X = {X(t)}o<t<T is unperturbed, 
then W(u) = AF for each trajectory u. 

Proof: By the Jazynski's equality (fTUj) and Jensen's inequality, 

e -fiAF = E P [0T] y e -pw^ > e -l3E P lo.T] W ^ 

i.e. 

E p l°' T W > AF, 
and the equality holds if and only if W{u) = AF a.s., i.e. 

T aiogvr, 

-{X s (u))ds = 0, P[ 0jT ] 



a.s. 



o 



ds 

Furthermore, if the inhomogeneous multidimensional diffusion process X = {X(t)}o<t<T 

log 



is unperturbed, then gl » g7rs (x) = 0, and consequently W{uj) = AF for each trajectory oj. 



Remark 2.10 In the homogeneous (steady state) case, the diffusion process is obviously 
unperturbed, which yields Wd = 0. So the theorems above become trivial. 



Recently, M. Baiesi et al. [T] have proved an exact fluctuation theorem for the dissi- 
pative work Wd, i.e. 

Pn {W d = X ) _^ x ^ ^ 



Pn (W d = -X) 

for each x, under some condition pQ Eq. 14], which can also give rise to the generalized 
Jarzynski's equality Ee~@ Wd = 1. They also pointed out that the diffusive dynamics on 
an asymmetric potential may not agree with this exact fluctuation theorem [TJ Fig. 2], 
while the generalized Jarzynski's equality (Theorem 12. 6p still holds. In addition, if the 
time-averaged dissipative work has a large deviation property with rate function I{x), 
then (|12|) leads to the Gallavotti-Cohen type fluctuation theorem I(x) = I(—x) — x. 



3 Physical meaning and applications 

3.1 Generalization of Hummer and Szabo's work 

In Jarzynski's original work [22], [23j [2H [25] and Crooks' recent work [21 [31 0], they de- 
rived the Jarzynski's equality through standard derivation of statistical physics for simple 



Afterwards, in Hummer and Szabo's paper [21] . it is shown how equilibrium free energy 
profiles can be extracted rigorously from repeated nonequilibrium force measurements on 
the basis of an extension of Jarzynski's remarkable identity between free energies and 
the irreversible work. But they misused the Feynman-Kac formula [281 Theorem 4.4.2, 
Theorem 5.7.6]. This well-known formula provides a stochastic representation for the 
solution v(t, x) of the concerned parabolic equation through the conditional expectation 
of the path integration of a specific stochastic process 0}, and v(t,x) 

can be regarded intuitively as an expectation with respect to the "weighted" phase space 
distribution (see j8|)). In the inhomogeneous case, this expectation is taken conditioned on 
the event {£t = x} at time t, while in the homogeneous case, x is taken to be the starting 
point of the trajectory of £, i.e. the expectation in the representation is taken conditioned 
on {£o = x} at the initial time. More important, the quantity v(t, x) in the Feynman-Kac 
formula actually should be defined by holding the final time T fixed and treating the 
time t as a variable, and in the inhomogeneous situation, the time interval for the path 
integration can not be shifted from [t, T] to [0, T— t] while it can in the homogeneous case, 
which implies that it is impossible to directly integrate the quantity v(t, x) with respect 
to x applying the initial equilibrium distribution to derive the generalized Jarzynski's 
equality. Therefore, from the mathematical point of view, the right side of |2H Eq. 4] and 
the quantity g(z, t) defined in [23^ Eq. 14] can not satisfy the Feymann-Kac formula in 
the inhomogeneous case. On the other hand, although the Kolmogorov forward equation 
is more familiar and intuitively natural for physicists, the path integration of the specific 
diffusion process (i.e. the quantity v(t,x)) can only satisfy the elliptic equation similar to 
the Kolmogorov backward equation according to the standard Feynman-Kac formula [28, 
Theorem 5.7.6], which is just another reason why Hummer and Szabo's derivation [21] is 
flawed. 

What they considered is the diffusive dynamics on a potential V(t, x) satisfying f Rd V(t, x)dx < 
oo, whose time evolution is governed by the differential operator Lt = • A(t, x)V + 
b(t, x) ■ V, in which A(t, x) = 2D is the diffusion coefficient and b(t, x) = DW(t, x) is the 
drift coefficient. Now, we can restate the results of Hummer and Szabo's work in the case 
of general multidimensional diffusion processes, applying the mathematical theory in the 
previous section. The statements below could be anticipated starting from [21j . but they 
are here rigorously derived. 

It is important to point out that in the homogeneous diffusion case, the force 2A~ 1 (x)b(x) 
has a potential V{x) if and only if the steady state is an equilibrium state [26l Theorem 
3.3.7]. In this case, the invariant distribution ir(x) can be expressed as the Boltzmann 
distribution 



Moreover, the stationary diffusion process with initial distribution density ir(x) is in de- 
tailed balance. 

Suppose that for each t G [0, T], the force 2A~ 1 (t, x)b(t, x) has a potential —f3H(t,x), 
then the quasi-invariant distribution 



n(t, x) 



e -l3H(t,x) 



and 



F{t) = -PT x \jx [ 



is the Helmholtz free energy of this diffusion process at time t. 

Therefore, W(u) = Jq ^(s, X s )ds defined in the previous section is just the external 
work done on the system, Q{u) in ([7]) is regarded as the total heat exchanged with the 
reservoir, and ([7]) is actually the extension of the first law of thermodynamics. 

The reversible work, W r = AF = F(T) — F(0), is the free energy difference between 
two equilibrium ensembles. And the dissipative work Wd = W — W r , is defined as the 
difference between the actual work and the reversible work. 

By Theorem 12.61 and 12.91 we get 

Theorem 3.1 Under the condition of Theorem \2.6[ the well known Jarzynski's equality 
becomes 



i.e. 



E P[o,t } [g-zW] = e -/3AF (13) 



And E p ^°' T ^Wd > 0, i.e. E P ^-°' T ^W > AF, which is an extension of the second law of 
thermodynamics. Moreover, E p l°> T ^W = AF if and only if 

fT 



f Q dl °d s 7TS ^ Xs ^ ds = °' P [o,T] - a - s - 



If the inhomogeneous multidimensional diffusion process X = {X(i)}o<t<T is unperturbed, 
then W^w) = AF for each trajectory u>. 

Remark 3.2 Although the existence of a potential for the force 2A~ 1 b(t, x) is not a 
necessity in our proof of Section 2, it is essential for the concept of free energy in physics, 
because free energy can only be defined for the equilibrium states. 

3.2 Generalization of Hatano and Sasa's work 



As we have mentioned in the introduction of the present paper, Hatano and Sasa only 
derived their result in the case of inhomogeneous Markov chains rather than diffusion pro- 
cesses, and they regarded the corresponding result in the case of inhomogeneous diffusion 



processes be the direct limit of that in inhomogeneous Markov chain case. From the math- 
ematical point of view, diffusion processes can be regarded as the limit of inhomogeneous 
Markov chains, but only in the sense of distribution rather than trajectories. 

Using the phenomenological framework of steady-state thermodynamics constructed 
by Oono and Paniconi [32], they show that an extended form of the second law holds 
for transitions between steady states, relating the Shannon entropy (also accepted as the 
common definition of Gibbs entropy) difference to the excess heat produced in an infinitely 
slow operation. A generalized version of the Jarzynski work relation plays an important 
role in their theory |16j . 

In their work, they studied a simple one-dimensional stochastic model of Langevin 
dynamics describing nonequilibirum steady states with drift coefficient -(— ^-^^ + /) 
and diffusion coefficient 2ksT = 1. What they are concerned with is to establish the 
connection between the phenomena displayed by nonequilibrium steady states and ther- 
modynamic laws. Three kinds of heats are defined: the total heat Qtot, the housekeeping 
heat Qhk and the excess heat Q ex , satisfying Q tot = Qhk + Qex- By convention, they take 
the sign of heat to be positive when it flows from the system to the heat bath. 

In the case of inhomogeneous multidimensional diffusion processes, the housekeeping 
heat 



where dXt is of the Stratonovich type. A simple example of this interpretation of the heat 
was implied in Sekimoto's work [3U] and explicitly defined in Hatano and Sasa's work [16J. 

It has been proved that for equilibrium systems, 2A~ 1 b(t, x) = Vlog7r t (x) [261 Theo- 
rem 3.3.7], hence Q ex reduces to the total heat Qtot- 

In the case of inhomogeneous multidimensional diffusion processes, the total heat is 
defined as 




(14) 




(15) 



Since 




and 



VH(t,x) = -iviogvr^x) 



we find that the excess heat defined in Hatano and Sasa's paper is just 



Qex{u) = Qtot(w) - Qhkiu) 

-V\og-K t {X t )dX t 



T 1. 



P 
T 

VH(t,X t )dX t 

l-T 



t BIT 

-AH(u) + J —(t,X t )dt 

(16) 



where Q(ui) is defined in (|7|). 

Denote (f>(t,x) = — log7r(t, x) to be the Gibbs entropy (also called Gibbs free energy) 
of state x at time t, then 

A<fi = [3(AH — AF). 

Therefore, 

W d = W-AF = (AH-Q)-AF = Q ex + ^. (17) 
So we can get the generalized Jayzynski's equality of nonequilibrium steady states. 
Theorem 3.3 Under the condition of Theorem \2.6\ 

Let S(t) = ((p(t)) = — J Rd ir(t, x) log ir(t, x)dx be the Gibbs entropy (Shannon entropy) 
at time t, then the extension of the second law of thermodynamics in NESS becomes 

Theorem 3.4 

A5 = A(0) >-P{Q ex ). (19) 
Moreover, —(3{Q e x) = AS if and only if 

rT <91og7T s 



ds 



-(X s (u))ds = 0, P [0i t] - as- 



If the inhomogeneous multidimensional diffusion process X = {X(i)}o<t<T is unperturbed, 
then —f3(Qex) = AS for each trajectory u. 

Therefore, the generalized entropy difference AS" between two steady states can be 
measured through —(3{Q ex ) resulting from a slow (unperturbed) process connecting these 
two states, which allows one to define the generalized entropy of nonequilibrium steady 
states experimentally, by measuring the excess heat obtained in a slow process between 
any nonequilibrium steady state and an equilibrium state whose entropy is known. 

As in [IB], from (|19|) one can derive the minimum work principle for steady-state 
thermodynamics . 
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